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Abstract 

•y v ( Pi - P q ) 

The nonextensive statistics based on the g-entropy S q = — = \_ l q — — 
has been so far applied to systems in which the q value is uniformly 
distributed. For the systems containing different q's, the applicability 
of the theory is still a matter of investigation. The difficulty is that 
the class of systems to which the theory can be applied is actually lim- 
ited by the usual nonadditivity rule of entropy which is no more valid 
when the systems contain non uniform distribution of q values. In this 
paper, within the framework of the so called incomplete information 
theory, we propose a more general nonadditivity rule of entropy pre- 
scribed by the zeroth law of thermodynamics. This new nonadditivity 
generalizes in a simple way the usual one and can be proved to lead 
uniquely to the (/-entropy. 

PACS numbers 

05.70.Ln Nonequilibrium and irreversible thermodynamics 
05. 45. -a Nonlinear dynamics and nonlinear dynamical systems 
05.20.-y Classical statistical mechanics 

1 Introduction 

This work addresses the problem of the application of the nonextensive statis- 
tics based on a g-entropy to systems containing non uniform distribution of 
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q values, i.e., containing subsystems which have different q's. The g-entropy 
for open systems is given by 

S q ( Pl ,p 2 ,...p v ,q) = - EU ^~ Pf \ q>0 (1) 

where Pi is the probability that the system is found at the state i, and v 
is the total number of states occupied by the system (let Boltzmann con- 
stant k be unity). This entropy is proposed first by Havrda, Charvat[l, 2] 
and Daroczy[3], who deleted the additivity requirement from the entropy 
axioms of Shannon[4], as a possible generalization of Shannon entropy Si = 
— Y^UiPilnPi 1 - Daroczy[3] further discussed in detail the properties of this 
entropy, including its nonadditivity for a composite system A + B containing 
independent subsystems A and B : 

S q (A + B)= S q (A) + S q (B) + (1 - q)S g (A)S q (B). (2) 

In the last decades, a nonextensive statistical mechanics (NSM) is derived 
by Tsallis and coworkers from maximizing S q [5, 6]. A main character of NSM 
is the g-exponential probability distribution : 

Pi = hl-aPE i ] 1 ' a [-]>0. (3) 

where a equals 1 — q or q — 1 according to the maximization process of S q [7] 
and Ei can be the energy (or any other thermodynamic quantity introduced 
into the process of maximum entropy) of the system at the state %. The 
validity range of NSM is still under investigation. Actually, a point of view is 
widely accepted that NSM can be used to describe nonequilibrium systems 
at stationary state whose probability distribution is time independent. This 
position is supported by the fact that all the actual applications of NSM and 
its g-exponential distribution in Eq.(3) are related to critical, nonequilibrium 
and chaotic systems. 

In this paper, we will focalize our attention on an important question 
about the applicability of NSM to nonextensive systems containing subsys- 
tems with different q's. For this purpose, we take it for granted that : 1) the 
g-entropy, as an information or uncertainty measure with respect to the prob- 
ability pi, is valid for some nonequilibrium nonextensive systems in steady 

1 In the formula of Havrda, Charvat and Daroczy, the denominator was 2 1 ~ q — 1 instead 
of 1 — q in order that S q (l/2, 1/2, q)) = 1 for whatever q. 
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or stationary states with time independent probability distribution pf, 2) the 
Janyes' inference method of maximum entropy[8, 9] applies for these states, 
i.e., the time independent probability distribution on these states can be 
deduced from maximizing the g-entropy. 

The above assumptions are necessary for NSM to be applied to nonequi- 
librium systems with the distribution given by Eq.(3). Due to the maximum 
g-entropy, the framework of the conventional equilibrium thermodynamics 
(CET) can be copied for stationary nonequilibrium systems. Essential for 
this work is the establishment of the zeroth law or the equality between the 
intensive variable (3 at state maximizing entropy S q . It is worth noticing 
that, due to the different formalisms of NSM proposed in the past 15 years, 
the intensive parameter (3 has several definitions and interpretations which 
sometimes cause confusion. A comment on this subject was given in ref. [10]. 

d S 

In this work, we choose a formalism allowing (3 = -^j- (we will call it inverse 
temperature from now on), here U q is the expectation of Ei discussed below. 

The application of NSM to systems without uniform q value distribu- 
tion is fundamental because a large number of systems in Nature, especially 
the systems far from equilibrium, the chaotic and fractal systems, are inho- 
mogeneous and may be divided into subsystems with different nonextensive 
property and q values. If NSM does not allow treatments of such systems, 
there would be an handicap in its theoretical formulation. In other words, 
if NSM can separately treat A and B each having its own q, it is also ex- 
pected to be valid for the total system A + B and to provide method to 
derive qA+B from q& and qs- This problem was recently discussed by many 
scientists[ll, 12, 13] on the basis of Eq.(2). The attempts were interesting 
but a rigorous mathematical formulation of zeroth law relating (3(A) and 
/3(B) is still missing. This result is not surprising because Eq.(2) is only the 
nonadditivity rule for the systems containing subsystems with same q. Its 
application to different g-systems is in fact forbidden. 

The aim of this paper is to show that, by using a more general nonexten- 
sive rule of entropy which generalizes Eq.(2), the establishment of zeroth law 
relating (3(A) and (3(B) is possible for the systems having different g's. This 
approach was recently described within the formalism of NSM based on the 
usual normalized probability [14]. In this paper, we are interested in extend- 
ing the approach to the formalism of incomplete statistics proposed several 
years ago by one of us[7, 15, 16], and providing in addition a detailed de- 
scription of the calculus allowing one to determine the q of composite systems 
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from the g's of the subsystems. 

Incomplete statistics is a version of NSM based on the notion of incomplete 
information associated with the normalization 

w 

£p? = i (g>o), (4) 
i=i 

here w is only the number of states which are countable or accessible to our 
treatments and may be larger or smaller than the number v of the phys- 
ical states occupied by the systems[16, 17]. It is proved[16, 17] that this 
incomplete normalization may arise for the systems whose phase space is 
occupied in heterogeneous (hierarchical or fractal) way and coarse grained. 
An example of such systems is the polymers described in coarse graining 
way by using contact matrix which makes it impossible to completely cal- 
culate the information contained in the sequence of monomers unitsflS]. It 
has been shown[16, 17] that q = df/d for the systems whose phase space 
volume is simple fractal of dimension df, where d > 1 is the dimension 
of the phase space when it is smoothly occupied. In this case, S q can 

be recast into S q = — ~y Pl [15]. For a composite system having joint 
probability given by the product of the probabilities of its subsystems, i.e., 
Pij(A + B) = Pi(A)pj(B), we still have Eq.(2) with only the change (1 — q) 
to (q-l)[7}. 



2 A nonadditivity of entropy prescribed by 
zeroth law 

Eq.(2) has been shown to be a special case of the composition rule[19] 

H[Q(A + B)] = H[Q(A)\ + H[Q(B)} + X Q H[Q(A)]H[Q(B)\, (5) 

where H[Q] is certain differentiable function satisfying H[0] = 0, Aq is a 
constant, and Q is either S q or C/ g [20], which allows the establishment of 
zeroth law of thermodynamics in nonextensive systems. As a matter of 
fact, Eq.(5) has been established[19, 20] for the class of systems containing 
only subsystems having the same q. It must be generalized for the systems 
whose subsystems have different q's. This generalization is straightforward if 
we replace the Eq.(l) of reference [19], i.e., S(A + B) = f{S(A),S(B)} 
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for uniform q, by H q [S q (A + B)] = f{H qA [S qA (A)}, H qB [S qB (B)}} (or by 
H q [S q {A + B)} = H qA [S qA (A)}+ H qB [S qB (B)] +g{H qA [S qA (A)\, H qB [S qB (B)]}) 
where H q (S q ) is a functional depending on q's with the same form for the 
composite system as for the subsystems, where q, qA and qs are the param- 
eters of the composite system A + B, the subsystems A and B, respectively. 
This functional H q (S q ) is necessary for the equality to hold in view of the 
different q's in the entropies of different subsystems. The function / (or g) 
is to be determined by the zeroth law. Now repeating the mathematical 
treatments described in the references [19, 20], we find 

H q [Q(A + B)} = H qA [Q(A)} + H qB [Q(B)] + X Q H qA [Q(A)]H qB [Q(B)}. (6) 

Eq.(5) turns out to be a special case of Eq.(6), and Eq.(2) corresponds to a 
H q [S q ] which is identity function. Now for A and B each having its own q, 
in view of the fact that the g-entropy of Eq.(l) must have the same form for 
any system, a simple choice is H q [S q ] — (q— l)S q for the version of S q within 
incomplete statistics, which means 

(q-l)S q (A + B) = (q A -l)S qA (A) + (q B -l)S qB (B) (7) 
+ Xs(q A -l)(qB-l)S qA (A)S qB (B). 

This nonadditivity generalizes Eq.(2) which is recovered when q = q A = qB- 

3 Uniqueness of S q 

Eq.(2) has been shown to lead uniquely to the g-entropy of Eq.(l)[21, 22] 
when the product joint probability holds. This result is not complete because 
it was obtained only for the systems of uniform q value distribution. The rea- 
soning can also be straightforwardly generalized to inhomogeneous systems 
containing different q's. In order to do this, the axiom [II]* of the reference 
[22], i.e., Eq.(2), should be replaced by Eq.(7), with other axioms unchanged. 
In this way, the Eq.(16) of [22], i.e., L q (r m ) = ^{[1 + (1 - q)L q {r)} m - 1} 
should be replaced by [l + {q- l)L q (r m )} = UZA 1 + (« - l ) L qX r )} derived 
from Eq.(7), where L q is the functional of the g-entropy, q and q\ are respec- 
tively the parameter of the composite system and of the subsystems labelled 
by / (/ = 1, 2, ...m), and r the number of states in each subsystem. This rela- 
tionship can be written as ln[l + (q — l)L q {r m )] = l n [l + (li ~ 1)^^ (?")]- 
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The same mathematics as in [21, 22] leads to S qi (l/r,qi) = L qi (r) = rQl _ t 1 

and Sq l (p 1 ,p 2 , ...p v ,qi) = %-i ■ 

This uniqueness of S q implies that Eq.(7) is intrinsically a possible com- 
position rules of the g-entropy which becomes in this way invariant with 
respect to the inhomogeneity of q values in the systems of interest. The q 
value in the entropy of the composite system can be determined from the g's 
of the subsystems, which will be described below. 



4 A zeroth law 

Now from Eq.(7), according to our starting assumption that the stationary 
state of the composite system A+B maximizes its g-entropy, i.e., dS(A+B) = 
0, we get : 

(q A -l)dS(A) , (q B -l)dS(B) _ Q 



l + (q A - l)S(A) l + (q B - l)S(B) 

(q A -l)dS(A) (q B -l)dS(B) _ p 

As to the nonadditivity of the quantity U q , it is in fact uniquely de- 
termined by the product joint probability Pij{A + B) = pi(A)pj(B) which 
implies that, if we want to split the thermodynamics of the composite sys- 
tem into those of the subsystems, the expectation should be defined by 
U q = J^iPiEi or U' = J^iPiEi/ J2iPi (it is evident that the normalized expec- 
tation U q = Y^iPiEi is no more factorizable). It is easy to show that, using 
U q and Eq.(4) as constraints, the maximization of S q gives : 

p i = hl-{q-l)(3E i ] 1,q - 1 N>0 (9) 

where the partition function is given by Z q = {Sjl — (q — \)(3Ei\ q / q ~ l } 1 / q . 
With some mathematics, we find 

Y,Pi = Z«- 1 + (q-l)pU q . (10) 

i 

Then combining the product probability and Eq.(10), we get 

Z\~*{A + B) + (q- 1)P(A + B)U q (A + B) (11) 
= [Zl~ qA (A) + (q A - l)P(A)U qA (A)][Z^(B) + (q B - l)(3(B)Uq B (B)\. 
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The energy conservation law of the total system dU q (A + B) = leads to 



(q A - l)(3(A)dU qA (A) + (g B -l)(3(B)dU qB (B) = Q 



which suggests the following nonadditivity : 

(q A -l)dU qA (A) (q B -l)dU qB (B) 
ZiPi(A) EiPi(B) 



0. (13) 



This relationship should be considered as a generalization of the additivity 
rule dU(A) + dU(B) = of CET. From Eq.(8) to Eq.(13), we see the necessity 
to choose the unnormalized expectation in order to split the thermodynamics 
of the composite system into those of the subsystems via the energy nonad- 
ditivity given by Eq.(13). By splitting thermodynamics, we means that the 
thermodynamics of the subsystems can be formulated exactly in the same 
way and with the same mathematical definition of all the thermodynamic 
variables and functions as for the total system. Without this splitting, the 
establishment of zeroth law would be impossible. 
Now comparing Eq.(8) and Eq.(13), we obtain 

/3(A) = 0(B) (14) 

with (3(A) = & a ^J A and (3(B) = d ^J B j^l which can be straightforwardly 

derived from Eq.(l) and Eq.(10). So this zeroth law is independent of whether 
or not the subsystems have the same q. 



5 How to determine the composite q 

If qA, qB, Pi(A) and Pj(B) of the subsystems are well known, the parame- 
ter q of the composite system is uniquely determined by the product joint 
probability. Using the incomplete normalization of the joint probability, we 
obtain : 

wa wb 

£p?(^)£p?(£) = i (is) 

i=i i=i 

or 

W A W B 

Y,(pl A ) g/qA (A) Y.(pT) q/qB (B) = 1 (16) 

i=\ i=l 
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which means g^ < q < g# if <Ia < Qb and g = g^ = g# if g^ = Qb- In what 
follows, the above result will be generalized to more complicated composite 
system containing N > 2 subsystems each having its own q. Suppose an 
integer ensemble K m = NH [1, m] = {1,2, ...,m}. The subsystems are char- 
acterized by [pi k , qk, rik] where k G and ik G N nfc - The joint probability is 
given by 

N 

Vix,%2—iN = IT P*k ( 17 ) 
k=l 

where 

$>£ = 1 Vfce^. (18) 

»fe=i 

Suppose that there is a g such that the joint probability is normalized as 
follows 

nirt2...njv 

E PU~.i.v = (19) 

il)»2— «JV=1 



then g is determined by 



JV n fe 

nix = i- (20) 

fc=i «i;=i 



To see how to estimate q, let us first suppose that each subsystem has 
equiprobable states. One gets, for the k th subsystem, p k = (l/n k ) 1 ^ qk . From 
Eqs.(17) to (20), we obtain 



N N 



u^) l/q =m< /qk )- (2i) 



k=l k=l 

Property 1 : q G [ming^, maxgfc] VA; G ttjv- 

Proof : Eq.(21) can be recast into (l/g)Sfc m n fc = J2k(^/lk) hin fc or 
(1/g) = mn fc]/Efclnnfc|. So 1/g can be seen as a barycenter of 

the terms 1/qk > with the coefficients Inn*; > 0. Hence we have g G 
[mingfc, maxgfc]. The property 1 is proved. 

We see that, if all the subsystems have the same number of states, we get 

1 N 

iV k=i 
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Property 2 : The property 1 can be generalized to subsystems having 
non-equiprobable states. 

Proof : Suppose q > maxg^ VA; <G N^r, we have Ya^ vi k < YHi*vT h = 
1 and, as a consequence, rU£? fc fc Pi k = Ei^.'.T/ Pl,i 2 ...i N < 1 which is at 
variance with the normalization of the joint probability. So q < max q^ V/c e 
Ktv- In the same way, it can be shown that q > ming^.. Property 2 is proved. 

6 Conclusion 

A general entropy composition rule prescribed by the zeroth law of thermo- 
dynamics is proposed for the systems containing subsystems with different 
g's. The usual entropy composition rule of NSM can be recovered when q is 
the same for all subsystems. The zeroth law, or the equality between the in- 
tensive parameters (3 of each subsystems, is proved to be independent of the 
q values of subsystems. It is shown that g-entropy S q is unique in the context 
of this general nonadditivity. A calculus is provided for deriving the q value 
characterizing the composite system from the q values and the probability 
distributions of subsystems. 

It is worth mentioning that this work is carried out within incomplete 
statistics by using the unnormalized g-expectation. It is found that, if 
one wants to establish relations between /3(A) and (3{B) when the sub- 
systems have different g's, the usual expectation U = Y^iVi^i f° r incom- 
plete distribution cannot be used due to the factorization of joint proba- 
bility Pij(A + B) = pi(A)pi(B). We would like to mention in passing that 
this constraint of thermodynamic splitting and of zeroth law establishing for 
inhomogeneous g-systems fundamentally changes the formulation of NSM 
with normalized distribution J2iPi — 1 because in this case we have to 
use a general product rule pfj(A + B) = p\ A \A)p\ B (B) for "formally in- 
dependent" 2 subsystems A and B instead of the usual product probability 
Pij(A + B) = pi(A)pi(B) as used in this work. Detailed description of this 
approach can be found in [14]. 

2 Product joint probability means independence of the subsystems and no interaction 
in the conventional probability theory. This meaning docs not apply for nonextensivc 
systems having interacting and correlating subsystems due to which the nonextensivity of 
entropy and energy can arise. So by "formal independence" we mean a statistical situation 
where interacting systems verify the product rule of joint probability. 
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